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UtXlizatioii of learner cognitive attainment as a 
measure of student teachep effectiveness is escployad in this study of 
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skill leyel of the* education aajoris through examination oi their 
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as well* a^* his/her overall grade- point ratio significantly account 
for the variation in learneips' performances! Time referehced 
variables, the gua^Tity of supervisor ratings assigned to the student 
teacher, and individual classroom teaching styles are also found to 
correlate significantly with* students' cognil;ive' attainment. (Lfi) 
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Cognitive Attainment of Learners of Student Teachers: .A 
Criterion for Attaininent Accountable Teacher Preparation Programs 

. Jort J . Denton ' ^ 

. Sherri n A. Norris 

- ■ . « » " 

. ■ Abstract 

This investigation was conducted to determine whether learfier cognitive 
"attainment data have potential for decisfon-paking regarding the cwhpetence 
of all prospective teachers completing a secondary teacher education program. 
Five conceptual models \^re developed for determining the effectiveness of 
student teachers in bringing about learner cognitive attiainaient. Structural 
regression equations for these models were dieveloped to analyze the data 
collected for 2540 secondary schdol learners and 21 student teachers. Comparisons 
of the various regression equations yielded results indicating the professional 
characteristics of .the student tea'cher namely, academic major and overall grade 
point ratio, significantly (F=67.69, df :2,2536} accounts- for variation among 
learner cognitive attainment scores., ' ^ 

Further analyses of these data revealed that education majors produced 
substantially higher cognitive attainment scores among thelr^ learners than 
did non-education majors* Other analyses indicate' that timfe-referenced va-riabl-es 
(F=23.52, df:2,2534) and supervisor ratings of the , planning and Instructional 
effectiveness of student teafchers tF=48.83, df:2,2532} also 'account for some 
of ^e i^ariability of learner cognitive attainment .values. As might be expected, 
positive relatigns were fouhd betw^n longer periods of time devoted to 
instruction and qreater learner cognitive' atta1/«^nt. SufJervlsor ratings of 
candidates were found to have a modest positive, relation with pK)re stjccessful 
learners. .This finding suggests that supervisor ratings, commonly used as the , 
primary evaluation tool In student teaching, need to be used in combination 
with other evaluation Instruments to d^ermlne the competence of teaching 
candidates^ One additional analysis addressed classroom behavior styles of 
individual 'student teachers (F«32* 46, df:21, 2511). This finding accounted 
for substantial variance- In lea'rner cognitive attainHent 1n this Investigation"; 
and has substantial significance for an interisive field experience if a teaching 

candidate's competence is based on- learner cognitive attainment rath^ than 

■ ■ . ■ ' - ■ ■ ■ ' ■ 

demonstration of "teaching-process" skills. \ ' . 
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The press for accountabnity In educational settings is no longer 
reserved for learners In public schools. Experienced teachers and teaching 
candidates applying for a position with the Dallas Independent 'School 
District now must pass a proficiency test before being seriotisTy considered 
as a viable -candidate for a teaching position in fthat district. Acc'ordinq' 
to Mitchefll (19^8), in a recent issue of Atlantic Monthly ^ this practice was 
init-iated because of the dismal performance records of many newly minted 
teachers with, recently acquired teaching certificates in hand. One 
wonders how and why this phenomengir has occurred, and what type of evaluation 
would allow ill-equipped. individuals to attain teaching certificates. 
Perhaps the experience of Dallas is unique, hi^ it does serve to e*nphasize the 
growing concern public school personnel officers and' parents have regarding 
the capabilities of teaching candidates and the ijuality of teacher 

• . ■ . ' ^ * ,- ■ , ' ■ 

preparation programs responsible for preparinS these individuals. . ^ 

The concern about teacher preparation program quality has long been. an 
issue of great impqrtance. Some time back a multi-stage evaluation 
system, was established to jnohi tor the development and implementat'ion of a 
aDmpetency_ based teacher education program. (Denton. 1977). Onf stage of this 
evaluation system focuses on, the student teaching experience where 
efforts have been guided by the conraon- sense notion that "successful 
teachers bring about learning in their charges." While this generalization . 
is straightforWdrd an?(^ easy to interpret, implenentation of a plan to, 
obtain performance data on learners is another, matter-. Thus, this investigation 
was conceited and conducted to determine whether learner cognitive attainment 
data have potential for decisibn-lbking regarding 'the competence of all 
prospective iteachers completing a , teadher' prepaffi'ti on program. 
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THEORmCAL CONSIDERATIONS 

A pV«c«^€7it\for using learner cognitive attainment as a measure of ' 

teaching success -dates back to^ tl?e scientific management era in American 

schools from 1910 to 1930 (Callahan, 1962). Apparently, this interest 

continued for some time given the Investigations ^y Rostker (1945) ,~Rdlfe " 

(1945), and UDuke (1945)..; These investlgatorsfcollected inuTtiple teaclier 

and. learner variables while examining teaching ability based on learner 

^chlevemen^. Interestingly, these Investigators employed rather elaborate 

statistical .procedures. I.e. , multiple regression, to explain the effects of 

teacher variables on learner achievement. ^ 

More recert'tly. Wittrock (1962) studied the impact of learner achievement 

■ ■■ . { ■ ■ . 
f gams on student teachers by telling the candidates their grades in student .' ^ 

^ teaching depended on. the performance of their le£H-ners. When pupil achievement 
of these teaching candidates were compared with pupil achievement of a similar- 
g^oup of student teachers who served ^s controls for this investigatlion. tjie 

' learners of the experlniental stud^t^ teachers were found to have attained higher 
scores on standardized tests in social studies and English. Unfortunately, 
the pupils of some of the experimental student teachers expressed more 
dissatisfact^ with their student teachers than did pupils of, the Control 
student teachers. 

CKjring the past decade o^ so, assessment issues in teacher education have 
received/substantial attention, due in paVt to attempts to plan, develop, and ' 
Implemeht-'competency b#sed teacher education (CBTE) programs. Two major * 
positions emanating from CBTE regarding assessment of teacher competency are: (1) 
procedures on the one hand which assess the process and practice of teiacHtlng 
candidates and (2) assessment techniques which encourage the collection of learner 
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attainmient information (consequence criteria) on the other (Weber, 1974). " 
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Many teacher educators favor the use of prpfies^ criteria for assessing 
the competence of a student teacher. An example of which would be the 
candidate's facility with creating a favorable learning set in a microteaching 
lesson, followed by a similar skill performance in an actual class situation. 
^'This multiple step process often is repeated for other presentation skills, 
such as, use* of higher order questions, prompting, and providing-aiapropriate 
* feedback, until the usual litany of teaching skills in a CBTE program have 
been practiced and decnonstrated by the aspiring teaching c^hdida^e. 
Proponents of the process approach cite measurenient problems, and 
~" ■ economic considerations associated with obtaining learnep achievement gains 
from standardized tests as major^ieterrents in using consequence criteria for 
assessing preservice teacher competence (GlasH, 1974; Soar, 1973 )l Medley (1978) 
cites a number of alternative strategies for j^<^e^ing teaching candidates, 
e.g., teaching tests, behavior samples, teaching exercises, classroom inter- 
action simulations, projected problem exercises, which with the exception of 
/the teaching tests are categorized among- the' "process criteria approaches for 
candidate assessment. Interestingly this emphasis on. prBcess criteria tends 
to dominate the p^fessional literajiure concerned with assessing the competence 
of preservice teachers 4Kay, 1978; Pottinger. 1978; Tikunoff & Ward. 1978). 
Thus, teacher educators who have labored with the issues of assessing teaching 
, competence in terms of consequence criteria (learner attainment) have 

encountered resistance because this approach it is said, places the fate of 

- . . ' \ - ' 

the teaching candidate in the hands of their learners. Proponents of • - 
consequence criteria on the other hand indicate that process criteria alone 
siiiiply do not yield adequate evidence that candidates have the necessary 

teaching competencies to succeed in the classroom {Brinkerhoff , 1978; 

• • • ' ' - . ". 

Oenton & Norris, 1979). 
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.i Further, tiicl^er educators espousing the latter position, find support 

for competence based on achievenent from the vigorous research activity on 
teacher effectiveness. In this area of interest, effectiveness is frequently 
defined in terms of the classroom teat her' s ability to produce higher than 
predicted learner gains on standardized tests. This criterion for teacher 
effectiveness is commonly cited io/investigations (Brophy & Evertson, 1976; 
Stallihgs & Kaskowitz, 1974; Good & Grouws, 1977) and reviews of research on 
the topic (Dunkin & Biddle. 1974; Good, 1979r«osenshine. 1976; Rosenshlne & 
Furst, 1971). Thus, teacher educators embracing the notion of including 
learner attainment data in decisions regarding the competenqq of pre-servica ' 
teachers have a sound body of empirical evidence-to~support their position 
■regarding learner achievement data and decisions regarding teaching competence. 

Perhaps ^n approach which integrates learner cognitive attainment data 
with systematic classroom observations is- the optimal assessment strategy 
for the preparation of ^teachers. McNeil and Popham (1973. pp. 233-234) have 
derived such a strategy which involves contract plans based on learner,' 
cogmtive gain. With little or no modification, this contract pi art can serve 

c as a strategy for assessina a student teacher's irompetefice. This approach is 
based on thevnotion that the objectives of the curricular'plah must bp agreed 
oji before' teacher ccwpetency can be assessed. Supervisors and the teaching 
candidate must agree on the a^^ro^Hateness of stated performance objectives 
for the learners. Further, agreement 1s reached before .instruction begins 
regarding what evidence will be used to determine whether the teaching has 
resulted in leariiier attainment Of the performance objectives. Data are 
subsequently collected to, determine whether learners have achieved the 
stated objectives as well as. whether unintended outconted have emerged. 
The evaluation plan need not exclude the use of observational systems in the 
assessment of Instruction, rather this plan recommends their use as means for 
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establishing descriptive records of the teaching act, ♦ 

On« significant advantage of the coht-ract plan for assessing teactier 
competence Is that it allows student teachers in conjunction with their 
supervisors to establish dutcomes and standards that are most appropriate 
for their learners. Prior learning, ^namics of the classroom, and classroom 
environment can be taken into account in pstablishing the instructional plan 
on which the student teacher is to be held accountable (^k:Nei^ & Popham, 1973). 
To this end the following research quesVfwis Were posed. " 
1 



Should teacher preparation program decisions regarding the qualifications 
^ of a teaching candidate he influenced by the degree to which acalemic- 
characterisitics of student teachers relate to learner cognitive attainment 
on a single instructional unit whdn the influence of prior cognitive 
attainment of those learners, is renKjved? 

2. Should student teaching guidelines provided fay the. teacher education 
program be affected if the period of instruction provided by .teaching 
candidate influences learner cognitive attainment on a single unit when 
the effects of prior cognitive attainment of learners and academic 
characteristics of student teachers are removed"? 

j ' ' 

3. Should teacher preparajtion program decisions regarding the competence of 
^ ' a teaching candidate be influenced by the degree to which university 

^ supervisor ratings of [the student teacher's planning and instructional 
effectiveness relate tjo learner cognitive attairwient on a single' unit 
when the effects of prior learner cognitive attalwnent, characteristics of 
student teachers and Instructional time are removed? 

■ ■ ■ j ■ .■ ' ■ • ■ » 

^ 4. Should teacher preparation decisions regarding program quality be . . 
influenced if the bel^vior of individual stuflent teachers affect 
' learner cognitive attainment ona single instructional unit when the ' 
, effects of prior learrner attainment, student teacher academic 
' • characteristics, supervisor ratings, and time on instruction are ranoved. 

ORGANIZATION OF INVESTIGATION "A ' 

grograrn Description • ; . , ' 

.' ' ■ < ■ 

This investigation ^as conducted under the auspices of an educational 
curriculum and instructiibn department at a Land Grant University. The teacher 
preparation program wh'ich participated in the investigation is a competency 
based pr'og ram for seconidary level teachers fashioned around a diagnostic ' 



prescriptive model of instruction {Armstrong. Denton, Savage. 1978). This* 
model conceptualized teaching as a series of events requiring five distinct 

4 ' 

sets of instructional skills, that is: Specifying Performance Objectives. 
■Diagnosing Learners, Selecting Instructional Strategies, Interacting with ^ 
Learne*s, and Evaluating the Effectiveness of Instruction. 

Specifying Performance Objectives - The decisions inherent in this element 
of the instructional model are instrumental in determining whether the entire • 
instructional process can be successful in producing student learning. Restatol^ 
this idea becomes performance objectives determine tl}e direction and. focus of 
instruction. When performance objectives are selected and sequenced according 
to a logical plan, teachers are in a position of -leadership and can justify 
their program to responsible critics./ 

Diagnosing Learners -^Teachers need 'informatiofi regarding a learner's 
readiness to begin a proposed new ins true tiorial sequence. Bypassing this step 
in 'an effort to save instructional time is false econojny, since ttie result ' 
may well be frustrated, bored and unmotivated learners'! ^When adequate 
diagnostic information's available, instructional plans can be developed that 
meet the informational and emotional needs of the learners. 

.Selecting Instructional Strategies - In selecting instructional strategies 
teachers should structure activities thitt.4H*e--6onsi stent with the identified 
performance objectives, the entry'levels of the learners, and the events of ' 
instruction espoused by Gagne' (1970). In a sense, selecting instructi'onal 
strategies is analogous to generating directional research hypotheses. A 
strategy is" created' from a wide range of possible approaches which, in the 
"teacher's mind, will likely bring about learner attairment^Gf the performance 
objectives. The appropriateness of this strategy is "testeid" during the 
impTementation and evaluation phases of Instruction. 



Interacting with Learners - This component represents the "doing" phase 
of the Instructional model. The elegance of the instructional 'plali becomes ' 
unimportant if the tiniing and continuity of the classroom activities are 
interrupted creating disorder and predictable management problems. Thus, 
learning how to interact with learners is, perhaps, the most difficult set 
of skills for new teachers to attain. Mastering these skills requires 
considerable practice in actual .classroom settings, and serves to jiistify 
the emphasis en student teaching experiences in teact^er preparation programs. 

Evaluating the Effectiveness of Instruction - This component serves to 
gather evidence during and after the teaching of an instructional plan to 
determine whether the plan "worked." Evaluation should prompt a review of 
each component in the instructional model. Representative questions to 
illustrate this review include: Were the perfonnance objectives appropriate?. 
Were the pretests reaflly diagnostic tools? Did the instructional strategies 
incorporate the events of Instruction? Was classroon manageiment suffi^jent ^ 
to mainta1|f a favorable learhing environment? Were the evaluation tools valid 
for assessing learner growth and program effectiveness? 

This model provides a framework that encourages the. development of 
individual teaching styles. Individualized styles are encouraged because 
evaluation of instruction is based on' learner a ttairment of performance 
objectives. Given this operating principle, teachers in preparation are free 
to choose procedures from their own repertoires . that they believe will 
result in high levels of learner performance. Further^ teacher responsibility 
is well served by this model. This responsibility come\ not because of the 
teaching candidate's adherence to a set of "ideal role behaviors," but rather 
in adapting ^Instructional practice, as necessary, to help learners achieve 
performance object ives'^'thatj have been selected. . . 



A firn^seftes'ter-fun day student teachtng program wItliAweTve seinester 
hours t>eing awarded for successful completion of the course Is the - 
culminating experience in this preparation program. During this experience, . 
each student teacher is required to develop and implement two instructional 
units each of approximately two weeks duration. The instructional units 

■ ■ V' • ■ 

are to include: performance objectives, a diagnostic pretest .to determine 
whether prerequisite knowledges and skills are present, instructional strjtegi 
addressed to each performance objective, and criterion-referenced instrum£ts. 
These units must be deeined acceptable and appropriate by both, the classroom 
supervising teacher and the^university supervisor prior to implementation. 

Evaluation of student te'achers in this program includes supervisor 
ratings based on in-class observations and instructfonal materials produced 
by the student teacher. Generally,six supervisor ratings are completed 
during a semester. These ratings are recorded' on an Evaluation Profile 
instrument. It may be of . significance that the final evaluation fpr each * 
student teacher recorded on this instrument represents a consensus rating' 
resulting trom a three-way conferpnce between the student teacher, classroom 
supervisor and university supervisor. In addition, a Curriculum Context 
Checklist for rating the components of each ins true tixmal unit is 
completed by the university supervisor. Two of these forms are ccnnpleted 
during the course of the field experience. 

Student teachers are also requested to contribute to the formative 
evaluation process by completing weekly reflection sheets throughout the 
seme'ster. Further, sumraative procedures are conducted by student teachers 
atthe conclusion of each unit, wl^re summaries learner performances 
are recorded on Summary Evaluation of Unit forms . These self -evaluation 
experiences are consistent with the final component of the diagnostic- 



prescriptive model of instruction. 

Only one type of data was collected for this investigation which - 

ordinarily is not collected during student teaching, that being, criterion 

referenced learner attalnn^nt data. In this investi^tion, student teachers 

retained the unit test responses of- learners 'after providing feedback to the 

. learners regarding their performance. These ■data'- were subsequently used 'to 

develop a criterioo-referenced summary on each ^earner. This sumna ry is a 

record of each learner regarding his/her individual performance wit|i respect 

to each performance objective Included in the iinit. ""in addition, pretest and 
■ , • *■ ■ • ■ -" - " ' J 

, posttest scores were' recorded for each learner on.the sutrmary. The objective 

attainment data expr»€ssed as the percentage of objectives attained in unit two 
for each learner has served as the dependeht variable in thife investigation. 
Sample * * - . '/ 

Information from 21 secondary level student teachers and -2540 learners 

'taught by, the student teachers comprised the sample for the data base of 

this investigation. These student teachers were sul3ervised by one university 

supervisor, over the course of three semesters, i.e. Spring 1*978 - 2 student 

teachers, Fall 1978 - 13 student teacher^ Spring 1979 - 6 student teachers. 

The total number of secondary level student teachers numbered 184. during 

this period (Spring 78 - 68;*Fall 78 - 64, Spring 79 - 52). The primary 

reason for selecting only the stLtdent teachers assigned to one university 

supervisor was to reduce error variance among supervisory ratings. The • 

university supervisor has served' In this role for three years and has " 

established good relationships with cTassroan supervisors and building ' 

adroinistrators in the student teaching sites represented^ in this project. " 

■ ; • . ■ - ■ -t 

Moreover, the supervisor is Well versed on the diag'nostic-prescriptive model 
'■' ■ • ■ ■ ' ■ ■ . - 

of instruction on which the preparation program is based and has held the 

•student' teachers accountable for implementing the tenets of this model in 



in tMr teacWn^. 



. Seventeen' cl. 



lassfoora s.upervfsprs from -7^. school, buildingd'sierv^^J^ the "modeT 
teachers*' for the studient teaches. Four supervisors in thiJi group -wlfed ■'. , " 
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with a student teacher for two of the thr^e semesters the data. Were call eitedv' 
while the remaining 13 classroom supervisors" served in this' capaciti' for , . * 
'oTie semes^erv . In order to qualify as a classr^jan supervisor; thgse' te3t2 hers, ' 
met the following qritisria: held a valid teaching certificate In t&e -field / 
In whTcH they were teaching, had Completed 2 fuj^l years of public school 
teacjiing experience - one of which was in the local district, agreed io serve 
as a classroom supervising teacher for both semesters, andagreeclto attend 
the inservice meetings sponsored by the Brazos Valley Cooperative Teacher 

■ ■ • . ; • ■ ■ »^ ' ' ■ ' • 

Education Center and other meetings sponsored by the ediicatignal curriculum 
and instruction department at the university. * f 

I/i order to enroll In student teaching each teaching ccin^Liji^te in thiis 
sample had met" the following criteria: ^ • • 

■* ■ ' ' . . , . ■ 

\ ■ K . Attained senior standing with^at least 30. ?efnester 
hours, completed at the universi-ty incTUdIng at least 
six semester houws in approved profess ionaj courses! 

"2. Attained a minimum grade point ratio (GPR) of 2.25 
based on the grade report form published by the 
registrar's office. / ; ' 

3. Comple±ed at least 75? of tie coursework requfred • 
for the two "24 hour teaching fields wlth^i, minimum 
GPR of 2.25; - ^ ... ; , 

* • . ■ . ■ . ■ - ' 

4. Adnitted to the teacher education program at, least 
, one semester prior to student teaching, The components 

for this criterion include a statenent of personal 
commitment, winimLBn ^rade point ratio (2.25), three 
letters of recommendations, successful coTipletion- . 
of Engl Is'h proficiency examination, arid *early field 
experience course (*r^u1red for EDCI 'riiajors). ' ' " . 

5. Completed ten hours of professional education 
coursework (EPSV 301-3hrs*. EDCI 323-3hrs, EDCI 401-7' 
4 hrs. ) . . ■ " . 



Alttu*^- the preceding' criteria, atoly to all secondary level student 

. ** V 1^ ' ■ \ ' 

teachersv-the ^j^ademic major does vary among teaching candidates. Education 

majors re(Hiired to'coin|)1ete a:J4 semester *hqur* sequence" of professional 

. ed.u€ati^A-j;vlt"?'^^V"Sjwi^th' t-Ke. 12"seraester hoiir student' teaching*, experience. 

'•4 J*' " ' • ■' 

Sqnyersel;^, nonieducation majors .seeking teache( certification are required to 
complete "4 E2 semester hour pro^>j%in''which also includes the 12 semester hour 
Student '■^eathing experience. -Differences in professfonal education 

CQursework between these types of student teachers include, an orieiitation 

* , ' ^- A ' ■ ■ - ■ , • . . ■ , • ' 

to education course (l.sw hr>, an early^ field experience course" (2^<2m hrsH 

a logic. of teaching course (3 sem.hrs), an adolescent psychology course 

(3 sem hrs), and on educational technol6gy.cour.se (3 sera.hr s)'. Generally., 

. ■ " • ■ , ■ ■ ■ . ■ ' ' , ■ ■' . ^ 

education ma jorscomplete the total sequence of coursewQri< over an eight > 

semester, period, Compared with'a three semester period for non-education 

ma jorC seeking teacher certification. . . / ^ - 

«>^he learners in this sample were assigned to the classes of 17 ^ 

classroom supervisors during the three ^enies'ter period these data were ■ - 

collected. These learners, attended' one ""of ther following "five rural school . 

■ ■ ■ '■ . ' „ • ■ . ■ ■ 

districts, namely: -> ^ " ^ 



B . . .(A,D.A. = 8412} h . .(A.D.A. = 1592) • 

C . . .^A.D.A. 1-303 N . .; 4A.D,A. = 1937)" * 

. C.S.. .(A.a.A. = 2898)^ ^ — . ^ ' . ' . * 

I nstrumentation ' „ - • . , - ;>.. 

^ variety of scales ^and. fr1terion-»*eferenced instruments mentioned in 

the preceding section ktere used in ohtainiag measures of the various 



independent variables_ and .the dependent variable^ fn ttiis investigation; The 
following briefly describes these instruments. An Evaluation Profits was • 
employed to obtain tfte independent variable, instructional effectiveness of 



the student teacher as perceived by "the unl vers Ito^ supervisor This 
instrunenb is cerapTeted oq a biweeMy basis by the untversity supervisor. 
:The scale, consists of twenty-eight. Clkert typd'.items divided into two 



categories, i.e.. Instructional corapetencies (21 jteras), and personal and- 
ppofessional competencies (7 items). Supervisory ratir\^s for the itenis 

under the heading, *ins true tionaV competencies,- 3^^^^ together to . 

provide t{j^ values for the instructiojial effectiveness 'variable. Each item 
on the scale Is 'referenced to a « performance objective in the student teaching 
program. Further,* the instructional skills addressed on this instrument 
are compatible, with the skil ls and knowledges stressed in the diagnostic- 
pr^riptive model of iri'struction, on which this program is based. The 
supervi$6r has the choice of narking one of five categories ranging from 
excellent = 1, to inadequate « 5, If the skilV is not observed or not 
applicable to the classrooro .Situation the supervisor has the option of 
marking !»f/A. The alpha coefficient, ct=. 94 determined for this instrument - 
suggests a ^igh degree of ^ternal consistency among responses to the . 
various items. . ' 

• ' •'• '.■„ ■ ' ' ■ ■ . ■ ■- , . , ' 

'. * ' * ■ ' . ' * ' 

A second rating scale, the Curriculum Context Checklist , is used to . 
provide' university supervisor ratings of the curriculac units devetoped'v 
by the student teacher. Values from this scale provide data for the variable 
planning effiectiveness of the student teacher. This Instrument contains a 
5 choice scale identical to the scale "of- the evaluation profiles. Individual 
items of this^ instrument identify components of the. currlculufTi unit* e.g' . 

•general goals, focusing* generalisations, goncept Ifst, diagnostic component'. 
Values. for the planning effectiveness variable are determined by s^jmrning , 

. togeth^ the component ratings registered for each item on this checklist. 
' Teaching candidates co^vtribute to .t^^e data base by completing two 



instruments which serve form«.t1ve. evaluation functions for the candidate ' 
and pravide time ordered daU for Rrogramajic reseaircH. One of the4e ' instruments, 
the Weekly Reflection Sheet request the student teacher to estimate the percent 
of time s/he .bas spent during the preceding week observing, planning, assisting, team 
,teachHl|', and/or* assuming fuir responsibility. In addition the candidates assess 
their morale afid provide a WriUen rationale for the rating/' These Instruments 
are submitted to the university supervisor 'at the end of each week throughout 
the semester. 

The second instrument. Summary Eva Tuat ton of Unit> is completed by the teaching 
candidate immediately after completing the instruction associated with each unit. 
This form requires an estimate. of the achievement level and socioeconomic level, 
of the learners in addition to the actual number of clas-s periods required to 
teach j:he unit. Perhaps the most significant information collected among^ all data 

recorded OR this form by the student teacher; this data being achievement/ 
infQrmation (learner attainment Qf individual unit objectives, prjetest scofes, and 
unit -posttest scores).' Xriterion-referenced tests developed by the student- teacher * 
are used to provfde these learner attainment data. These instruments, unique for 



each unit and each student teacher, represent a strength yet potential limitatton- 
in the design of this investigation. As a strength the student teacher, with 
guidance from classroom and university supervisors, develops tests related directly 
tb'the outcoines established for the performance objectives in each unit. Prior . 
lea/ning, extenuating fclassroom situations, and the abilities of the learners are 
taken imo account in establishing both the objectives and the corresponding 

■ ■ i . 

criterion tests. Under these, conditions, the cognitive attainment measure indeed 
should sample the i>ehavior called for by the performance objectives of the unit. 

A potential limitation of candidate-developed criterion-referenced tests 
stems primarily from the lack, of Information on. the reliabil ity and validity of 



the respective Instruments. Coriventlcmal reUability procedures appropriate for ' 
norm-referenced tests are not determined on the various criterion-referenced 
tests because the tunct ion of these tests (to detennine an examinee^s level of 



functioning with respect t^' a stated criterion) is not consistent with the 
function of rjpnn-.referenced. tests (determine an_ individual's jierforman'ce with 
respect to. the performance of others in th* ^roup) (Millmdn, 1974). Thus, 



although we are concerned, we'- are not unduly alarmed by the absence of these \ 
values. Validity of criterion-referenced instruments on the other hand, can be 
a^ssessed by determining the. logical relation, of the performance objectives and 
the individual test items. Fortunately, this validity check was conducted. by the 
classroom and unversity supervisors on each candidate's test before the instrument 
was administered to the learners. . , 

While the preceding ranarks are reasonable, we do realize measurement concerns 
' regarding the equivalence of the 21 criterion-referenced tests have not been 

♦ 

addressed, Certainly no claim can be made that all of these instruments were 

■ • ■ 

designed to measure attainment of identical content; however, it was possible to 
determine whether the levels of cognitive functioning (knowledge and^ application) 
, addressed in the tests were^' nearly uniform. Table 1 (Appendix) presents a sunmary 

':• , - ■■■ . ■ •■ ■ 

•of characteristics for unit two tests developed by the student teachers. In ' 
nearly all instances ♦ a preponderance of objective type test items designed to 
measure the knowledge l^vel of functioning occurred. Application level test items 
occurred on five examinations, but invariably, these questions represented only 
a small portion of items on the examination. This finding isn't too surprising, 
since lower level objecCfves are more reliably, measured by objective type test 
Items. -Further,, the candidates in this^ investigation -tended to require extensive 
products, such as* term papers and comprehensive laboratory reports when higher 
order cognitive objectives were included in the units.. 



. - STATISTldAl. DESIGN- • ' ^- 
ConceptuaUReqression Models ^ ^ . . 

During th^ past decades, 'sulistan'tlal ^nterest has centered on the 

developraent of conceptual models for document In^'the educational process. 

■ . ■ ■" " ■ ■ ■' ' ' ■ ' ' 

Typically, these fliodels have been constructed "to explain an individual 's 

educational achievement In terms of the following factors: individual "and 
family characteristic^ ."peer group influences, genetic endewment^,. school 
resources, and :Study attitudes (Barro. 1970. Hanushek, 1972; Magoon, 1979). 

One difficulty encountered with the early conceptual models for ex- 
plaining educational achievement was the selection of an appropriate 
statistical model. Multiple regressiontechniques, which were relied on for 
similar model building in agriculture and economics ."pf ten yielded incon- 
sistent estimates when applied to empirical data frdm the schools. Qne 
reason for these unstable estimates is the h'igh tnterrelatiorTships anjong 

educational process variables, which i-s. krlown as th6 multicollinearity 

■ . ■ " ■ . " . ■ *>' . . ■ ' ■ ■ ■■ ' 

pmblem in statistical analysis. S solution to this problem is to combine 

The variables wfvich are highly interrelated. This approach combined with a 
system of r equations can lead to* fairly accurate parameter estimates among the 
independent variables (Cooley and Lohnes, 1976; Murnane, 1975). 

The^e procedures were ..employed to develop a system pf five' linear 
structural equations to address the research quesrtions' for this investigation. 
Each structural equation takes the form of a regression model to illustrate 
the estimation requirements for the variables being considered. These 
%>dels and a corresponding legend are presented in figure 1.- 
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model \: Yg « b^r^ * £(1) ' ' ^ ; . ' . — 'T' — - 

model 2: « b^i^ * [b^P^ + bf^} ^ EU) . . ' 

Wdel 3: Y^ « b^Y* Ib^?^ + b^P^l + 1^ Vl * Va^ ^ ^ . 

model 4:- Yg;. b^Y,> Ey^ + b3P2] + [^4^1 ^ ^ ^^¥l * ^7^2^^ ^^^^ 
model 5: hh^^^Z^^^^ W *6^Vf ^ ¥2^ ^hh^'^ h^z^ ^ ?i,.C^;^E{5j 

. : — — - — ... ^ ■ . . , ' .. : ~ '• 

Yj * l*earner cognitive attainment oK the second unit developed and taught by * 
^ ' : a student teacher. (Percentage of objectives attained in unit 2) 

Y^ • » Learner cognitive attainment on the initial unit developed and taught 
by a student teacher. (Percentage of objectives attained in unit 1 1 

b| » Least squares weights associ^b^ with the Initial seven variables. 

» The error^of -prediction vector for model 1.^ 

■ * ' , ■• ■ ' • 

« Overall grade point; ratio for university coursework- completed by 
student teacher. 



^2 = Undergraduate major of student t-eacher. One if the student teacher 
was an educatipn major, zero otherwise. ^ 

Prior solo teaching time of student teacher. 

'2 * Opportunity to learn time provided by student teacher. 



at 



Umversity supervisor quality, ratings of second Instructional unit 
prepared by student teacher. ■ 

* - ■" ,■— . • V ■ ... - 

» University supervisor quality ratings regarding Instructional 
effectiveness of. student teacher during the teaching of the second unit-. 

* 1 If the learner was assigned tj) student teacher. 1 , zero ottjerwise. 

Least squares weight dissociated with each C^.. . 



K 



- ■ Figure 1 

Five Regression Models for As sessin g factors which Influence Cognitive 
Attainment of Learners ^ v. ' 
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In model V, »1 earner cognitive attainment on a second unit developed 
and iiapleniented by a student teacher depends, on the ^earn^r's prior 
cognitive attainment {performance on the initial untt taught by the- 
studen^ teacher) . Inherent; in this regress iorj model is the- astumption 
that the effect of an instructional iinit is independent of the student ' 
teacher's academic background, her/his planning and instructional skills, 
and the tirae allowed for instruction, v jJstiflcation for i^ie inclusion • 
of model 1 in the system of equtftions developed for this investigation, 
is strongly stated by Bloran (1976, p 68)i wher^ he affirm? that cognitive 
"entry b€h|vior cah account for a^ much as 50!^ of the variance 'on related 
cognttive Sichievement measures over subsequent learning tas4ii? - / 

^todel I presents learner cognitive .attaimnent on. a second instructional 
unit taught by a student teacher as a function of the learner's prior 

■ , ■ • 

cognitive attainment and the student teacheri^ academic background. 
Underlying this model is the assumption that the effect of a specific, 
instructional unites influenced by the professional preparatior^ i.e., 
collegiate grade point ra^^io^d academic major, of the student teacher. 
The collegiate grade point ratio is based on a four point grading scale • 
and computed from all coursework completed by the teaching candidate. 
The academic major of the teaching candidate is a categorical variable 
with two classifications, namely; education major, non-education major. 
Justification for the presehd^ of 'rtfiese variables in model 2 is based 
on asiiMTied positive relations among earned grades, ijuantity of courseworJc 
and knowledge of the student teacher. Knowledge of the teacher and the 
subject being taught, have been. shown to influence the achievement of ' 
learners (Coleman, 1975; Denton & McNamara. in press). 



Model 3 presents learner cognitive attainment as a function of 

the aforeajentioned variables. (prior attainment of learner, student 

-teacher background) an^two^Bwasures of " time (prior solo teaching time 

■ » . , * ' .- 

of the student teacher and opportunity t/p learn time). / The assumption * 

underlying Model 3 Is that the effect of Instruction "in unit t*«)^ ' 

depends in pan on prior instructional time |pd the time allotted for 

Instruction In the second'ujiit as well as the student teacher's 

professional bacKground and the cognitive entry behavior of learners. 

■ ■ , ■ » • - 

Both of these time referenced variables were determined in the 
- same manner, that is, the number of instruGtional periods devoted to * 
the unit Jere multiplied by the length of the instrxictional periods 
expresseCIn minutes. The value for prior-sol o-teaching-time was 
determined for the first unit developed and implemented by the student 
teacher while the dpportunity-to-learn variable was determined with 
values from the second unit taUght by the student teacher. These 

■•I' " *« - . ' ■ . • 

time-based veiriables were Included in this model because of the theoretical 
considerations of tlm^ In the oft-cited model of school lelrntng by.-^ 
John Carrol 1^ (1963). Further, recent literature on teacher effectiveness 
indicates t1n^-on-task of ^both teacher and learner is correlated with 
classroom^hievement (Good, 1979; Medley. 1977; Stal lings.. 1977). 

In model 4. learner cifgnitive at tai mien t depends on the planning and 
instructional skills of the student teacher as perceived by the 
university supervisor as -well as all of the independent variables 
included In model 3. The assumption behind model 4 Is that the effect 
of, instruction. in unit two depends on the planning- and instructional 
skills of the student teacher in addition to prior instructional 
time, opportunity to learn time and the student teacher's professional 
background. Supervisor ratings were included In this model because 



of the general acceptance df thi^'Eype of eval^iative procedure In 
assessing the competence of student teachers, (Bennle, 1972: Henry 
Beasley 1972J. If^pervisor ratings do accurately reflecj/^he teachf^ng • 
candidate's planning and insti^uctidnaV ski lU, the;?f?5)ese va 
should account fon some of the variance in learner cognitive attairunent. 
As' noted earlier, planning, effectiveness of .the student teacher was 
determined by sunwing together the unit 2 conponent raj^ings cm the 
curriculum context clieckH St. Simifarly,, the instructional skills 
variable was obtained by suraning the final supervisor rati n§s across 
all 21 items dealing with. .instructional competencies on the Evaluation 

. Profile instruii«n?7 ' 

Finally, model 5. combines all of the predictors presented tn model 
4 with the influence on learner variability accounted for by the " 
qlassroOT -behavior of individual student teachers. -This modeUpermits 

determination of whether individual teaching candidates'JQStructtonal 
behavior have a differ:^t effect on learner a ttairwsent when prior 

. learner attainment, instructional time, prof^sionaV characteristics" 
of the candidates and supervisory ratings of instructional. and planning 

- effectiveness are held constant. ^■ Operationally, model 5 clusters the 
variabiles under consideratidn in model 4 into 21 groups, then analyzes 

■ ■ *- , • . . ' 1 ' 

t|jkir trelatiqnshjp to one another. The grouping process is accomplished 
By creating ^n array of class if icatory variables(duniny variables), ^ach 
of which represents :a student teacher and t+te learners ass igAed to hfr/him . 
PrecfcKlenge for examining the influence of individual teachers on 
cognitive attainment ^ists in the literature on progr^n evaluation 
^(Denton & McNamara, in press) and educational policy research (Murnane, 1975) 



Thei-um't of analysis selected for .each of these regression jnodels 

■ - - * '. ^ , ». ^ 

■ ' , ■ . ■■ - ■ ' . ■" • 

was the le'anier rather then the student teacher. -This decision was ' *" 
raade to. permit maximira Variation of the 'dependent variable to be/ taken 
'.into account by th^ various' models developed for this ir\vestigatW^ - ' " - 
Further,- regression modely 5 (figure 1) simply would not have been 
possible had the data be^n organized with the student teacher as the! 
unit of , analysis. Sinqfi the. focus of the investigation' is the process 
of assessing the coropetWe of a student teacher, not assessing the ' 
student teachers* per se, the arguments given for teachers as the unit 
of analysis in 'teacher effectiveness research do not automatically • 

apply to this investigation. i , • 

- ■ ■• . ■ 1 • - 

Statistical Analysis I 

These five regression models v^re analyzed ari^ tests of significance 

were j3er|onnpi to.statikti.cally address each of the research questions. 

The expresS|$ons used for these tests are presented in figure 2, These 

f ' ' :' ■ . ■ ' ■ ■ ■ ' 

expressions, perroit US to examine the contribution of a subset of 
variables to the explained variation in -learner cognitive attainment 
While holding constant the contribution 0? variables previously • 
introduced into the regression equation. This process is illustrated 
in. the following descriptions of the various tests for the four' research 
questions of ^is investigation. - 

Research question 1, which addresses the academic characteristics of 
student teachers, is tested by comparing regression models 1 and 2. If 
the observations are consistent with our expectations, the coefficient ' 
of determination or explanatory power (R^) of model 2 should be larger than 
the coefficient of determination (R^) for model 1 . The increased explanatory 
power of model 2 then i^ attributed, to the professional background of the 
student teacher after the influence of prior cognitive attainment of learners 
has been taken Into account. - 



fientriti «e<l Expression 
QI: F « r| > /2' . Q3: F - - 



/ r - r| / 2536 * . ' ^ 1. -R^ 72532 

Q2: F = - ,r| ^ ^ 'Q4i 



• ^ 1 - r| 72534 ' 72511 

- ' ■ " 

Q^. =* research questions 1 - 4. • . - 

R|+=% coefficient of detennination for model (i + H=var1ance accounted 
for b^f model {1 + 1). / 

N * nutofaev of .learners^ In model (i + 1}={2540 learners In all' models). 

K = total number of independent variables in model (i +1) « (3 to 28). 

H « number of additional independent variables in model {i +1) which 
•were not incliided in model (i) = (2 or 21"^. 



Figure Z 

Gener.a]ized Equation an^l Corresponding Significance Test 
Expres$ion (F - ratios) for Research Questions 1 -*4; 



To test research quest iof% 2, which emphasizes instructional time, 
a comparison of models 2 and 3 is made. If the observations are consistent 
with our expectation, then model 3 should provide a significant increase 
in explanatory power p^er that of model 2. 'These two nKKlels differ due 
to the contribution of time based variables in explaining the variance 
among-learner cognitive attainment values./ The F-test for this comparison 
determines whetJier the variance in learner cognitive attainment accounted ' 
for by th^ time referenced variables >s significant when, the influence of 



prior learner 'attainment and characteristics of the student teacher 
are Jield constant. "H 

The process is reipea ted to test research question \. which focuses 
on the planning and instructional effectiveness of the student teapher. 
to test this question, a comparisbn of models 3 and 4 is made. Again, . 
ff the observations are consistent with our expectations regarding this 
research question, then the explanatory power' of model 4 should exceed 
the explanatory pc»«r of model 3 due to the' planning and instructional 
effectiveness of the student teacher. Stated another way a significant 
F-value for this comparison will indicate that teaching skills of the 
-student teacher do .influence learner cognitive attainment, even when 
the influence of learner prior attainment, professional characteristics 
of the student teacher and instructiCnal time are taken into account. 

Similarly, the final^ research question (question 4) is tested by 
comparing models 4 and 5. If classroom behaviors of indfvldual student 
teac|jers Influence cognitive attainment among their learners in a 
distinctive fashion, then the explanatory |»wer of model 5 should be 
Significantly greater than the explanatory power of model 4. A 
significant F-value resulting from thvs^comparlscsn will Indicate that 
classroom behaviors-of individual student teachers do influence learner 
cognitive attainment when learners of each student teacher are clus'tered 
and compared while holding constant the Influence of the variables 
considered in model 4. ^ ' „ . • . 

' . . /.FINDINGS 
The analysis as^^oc la ted 'With research question 1 yielded a F value 
(F 67.69," df:2.2536j which is statistically significant ;{p < .01). Tiits 

I « 

result indi^cates the profess-i^nal characteristics of the. Student teacjter 
which were included in this analysis explains approximately 4M^-the 



variance In I'earner cognitive jittainraent which is not explained by 
prior attainment on a preceding unit of instruction. ' The characteristics 
considered in these procedures were whether the candidate ^as an' - 
education major and the overall grade point ratio oT the candidate." . ' 
The college major variable was determined to correlate modestly 
with cognitive attainment (rp^. = .23), while the overal 1 grad6 point 
ratio of the candidate -was found to, correlate only slightly with the 
criterion vari^ible' (r = .13). Further examination of the data revealed 
that learners of educationnnajors attained higher average cognitive 

* ■ ' , . • . ■ ■ * . 

attainment values Xx,« 69.0) than learners, of non-education majors 

■ . . ■■ ■ ■ ■: • ' 'v ■ 

(x * 58*9), These values were somewhat surprising because. cognitive 
attairwent m^ns associated with unit one for the two^g roups 
learners were nearly equivalent, 67.6 and 67.3 for learners of education 
majors. and noji-majors, i^spectively. Moreover, grade point ratios 
HH^rall college coursework" completed by the t^ching cahdidates were. • 
found to differ only slightly between education -majors (GpR = "3.00) 
and non-majors (GPR =2.89). Other factors which potentially influenced . 
the difference in learner cognitive attainment between these groups- 
of student teachers will bfe presented subsequently. 

a ■ • 

The statistical comparison for research' question 2 produced comparable 
results. The result of this comparison (F = 23.52, df: 2, 2534V. p <;01) >, 
ihdicatas the exp-lanatory power (1 .4 .percent of the variance) of the a," 
time-refereneed variables, prior solo teaching, time, opportunity to leari^ " 
time pn^vided by £he student teacher in the second unit, together account 
:far sHgbt but statistically significant differences .in learner 



*i : ■ 

4^' 



cognitive attainment on the second unit. Examining these data from the 



perspective of the quantity of time allotted for 1nstruction''by 
teachirni candidates \idK> were education. majors and those who were . 
n6n-;p}aj6rs revealed: the average* prior-solo teaching time for 
edutati on-major s was 621.4 minutes and .657.0 minutes for non-njajors; 

^ and the opportunity -.to-learn-time, averages were 547.1 minutes ^nd 
407.9 minutes for majors and^jioiiHnajors, respectively. Whi^e the values 
for prior-solo teaching time are comparable, the Valjje^ for the ■ 

* instructional time devoted to uni t two were! mre disparate. These 
findings are .consistent with teacher-effectiveness research, since 
learners of education-majprs who attained higher cognitive values 
were provided with a greater amount of direct instruction. 

The third analysis was addressed to retearch question 3 ^ where the 
coefficients of determination for models 4 and 3 were cwnpared. The* 

Icesulting F value for this ccHuparl son (F »"48.83, df :2,2532, >< .01 } . 
indtotes the explanatory power (2. 8t of the variance) -of the university 
supervisor's ratings is Statistically Significant. This finding 
indicates tlifi, i^ercept tons of the universi.ty supervisor regarding the 
planning and instructional competence of the student teacher .do predict 
to some degree, learner cognitive attainment when prior cognitive 
attainment, ,professional characteristics of the student teacher, and 
measures of instructional time are held constant. The zero order 
correlations for the planning and instructional effectiveness ratings 
with learner cognitive atta inme nt are .08 and -.oa^^espectively. 
Further, instruct ional and . planning, effectiveness averages . :£«StN . • 
superviso^r rating's were determined to be 27 and 25 .f of education 
aajprs, and 29 and 27 fpr^hanniajors. Due to ins trun^nt scaling, 
higher or better ratings were designated wjth lower ni«}er1cal values, " 
thus 27 represents a slightly higher rating of Instructional effectiveness 



than doe$»the value 29. However, these sTmUar mean values between 
the najors and noh-ajajors combfnecl with th^low zera order correlatibos 
(.08 and-.06),Vand the diminutive explanatory power value^.8%) 
raise validity questions about the practice of using supervisor 
ratings a» the §o1e Joeaiure for awarding the grade in student teaching. 

Analysis of data, associated with resear9h 'question 4 provSded yet 
another significant -f^tistical finding (F « 32.46. df:21.25li. ]J<.01). 
In contrast to. the preceding results however, the "variance on learner 
cognitive attiaifsnent accofmted for by the variables under, review, 
behavior of 'individual student t'eachfer. was substantial (T5.5%). - 
Descriptive sumnaries on each variable In model S were not determined,' 
yet it is clear from, the inferential values that sufastantiaV 
differences aniong these variables dp occur across different student - 

teachers. / 

. 1 ■■ ■ ■ • ■ ■ ■ ■ ■ 

^•A summary of the inferential tests for the research questions are 

presented in table 2. Adclitlonal statistical summaries M each 

model are pre/ented in tabies3-7 (Appendix). 



yhile there are a variety of ineans ami ends for de^termjning 

the competence of a student teacher, the criterion variable used in 

this investigation, cognitive attainment of learners, places special 

^ emphasis on the results of the teaching candidate's teaching skills. 

. To man^* teacher educators, this approach places the fate of teaching 

candidates in the hands of their learners . who may not be motivated 

or possess the prerequisite cognitive skills to succeed. Conversely, 

, . ■ t 

the contract plan described by McNeil and Popham (1973) which was 

■ I ■. . • •■ • 

iiKorporated' into the design^ of this investigation enables the.^ teacher 

.4 ■. • ■ ' ■ ' 

to account f^jr the entry levels and dispositions of the learners in 

the devfilopment of a "learning contract." This point and counterr 

. . point represent only one* aspect of the multifaceted process of assessing 

• a student teacherH competence. While this professional issue 

regarding how to assess a teaching candidate's competence is far from 

being a closed coticern, this investigation has assun^d ^learner cognitive 

attainment to be the basis for assessing teaching candidate ctuipetence. 

Given this assumption* i|e have examined learner cognitive attainment 

in terms of variables commonly assessed either before or during the 

student teaching experience^ - 

Research question 1 addressed the effect of academic characteristics 

of student teachers on learner cognitive attainment in, a single instructional 

unit. The results of this investigation indicate the teaching 

• ,' candidate's academic major and overall grade point ratio do relate to 

the peifformance of learners. Although these characteristics were 

treated together in theanalysi^it is intereisting that academic . 

characteristics of teaching l^andi dates do explain $ome variation |n 

learner cognitive performance, in a single instructional unit, when prior 



learrter performance is held constant. This finding is consistent with 
research reported b^y Denton and McSaifl3ira (l^n press) which indicates 
professional characteristics of a teacber, i.e.., classroo&t experience, 
workshop particifjation, knowledge of content, do explain sufficient 
variation in learner cognitive attainment to be statistically significant. 

Collectively, these findings provide a modest empirical justification 
for teacher ^ucation admission requirements which specify grade point 
requirements, since the relation between learner cognitive attainment and 
' teaching candidatei grade point ratio was positive. That is, the iiigher the 
student teac/ier's collegiate 6PR, the higher the cognitive attainment 
of learners in a single instrjictional unit. However, one must remember 
this characteristicx was linked with the major of the teaching candidate ■ ^' 
to produce the explanatory power reported for academic characteristics 
of the candidate. 

The influence on learner cognitive attainment regarding whether the 
teaching candidate was an education major or in certification seeking 
student (non-education major) was also addressed in research question one. 
The difference in performance of learners associated with the major of 
*the student teacher re;por ted in this investigation has not been reported^ 
in the professlpnaV literature. Since, the characteristics were linked 
in the analysis, these observations are offered as areas for further 
research, but the observed relation In this investigation was that learners 
of education majors attained higher cognitive attainment values on a 
single instructionaT unit than their peers who were instructed by . 
student teachers who i^ere non-education Inajors. Perhaps this finding was 
an artifact of the sample and cannot be replicated, but since each 
group contained iwire than lOOO learners, these findings may well 
be stable. If this observation can be replicated and observed 



under more strfogent condUions, perhaps justlfftation will result / 
for greater emphasis on educational theory and practice in teacher ' 
preparation programs. 

The block of time referenced variables addressed in research 
question 2, prior solorteaching time and oppbrtunity-to -learn time, 
accounts for a s^iall but sufficient amount of variance regarding 
learner cognitive attainment to be statistically sigRificant. This 
resul t corresponds to the current '1 i terature on teaclj'er. effectiveness 
which underscores the importance of time-on-task on learner' achievement. 
(Good. 1979;"Medley, 1977; Stall ings» 1977). As noted in the. findings, 
the greater the instructional itimf devoted to the unit the greater 
the cognitive attainn^nt of learners. While not specifjcally addressed 
in the Titerciture, prior solo teaching time was included in this block 
of variables since the amount of previous instructional time in student 
teaching should affect the competence of the student teacher. * This 
conjecture has merit if for no (Sther reason than far the candidafte 
gaining confidence and establishing a routine for. managing the classroom 
during instruction. Further, data for these time based variables^ 
were Obtained redd fftr and easily from the student teacher's instructional 
plans and confirmed in the Summary Evaluation of Unit forms; completed by 
the student teacher. * . T 

Wtiile the explanatory power of these variables is small, it is 
interesting that such global raeasures_of instructional time account for 
enough variance in learner cognitive attainment to be statistically 
significiht. $ince these time n^asures did contribute to the explanatory 
power of* the model, it is plausible that other time-basgd measures, such 
as, studeni teacher planning time, student teacher time-on-instruction» 

f.. ' 

and weeks of student teaching jnay be fruitful extensions of this research. 



SiiaiUr1y» values for the planping and instructional cotnpetence of 

the student teacher, the block of variables fpr research question 3. 

i«re readily obtained from the final evaluations of the university 

supervisor. Since the practice of evaluating the studentieacher on 

the basis ot supervisor ratings is so coromon, it is comforting to find 

these ratings do account fof enough variance regarding the cognitive 

attaimaent of learners to be statistically significant. On the other ' 

hand./an explanatory power of 2,8% of the variance faiU to inspire a 

great deaV of confidence in university supervisor ratings as a sole 

criterion /or awarding a grade or certifying the teaching d^iinpetence 

of a student teacher. Perhaps whasis on observation data 'which 

provides frequencief of instructtpnal procedures coupled with supervisory 

ratings would ^enhance the explanatory power of these ratings. Further, 

perceptional data from learners of student teachers on the instructional 

competence of the student teacher might be ctwablned .with supervisor 

ratings to enhance the explanatory power of these values. In arty event, 

the practice of using university supervisor ratings as the only 

criteria for "grading" the student teacher Is not supported by the 

results of this investigation. 
% ■ 

The final research question addressed the. effect, of teaching 

behaviors of, the teaching candidate on learner cognitive attairment 

■ • -- ' ' ' ■ ■ ■ ' t ■ 

in a single Instructional unit. The finding Was that a substantial 

portion of variation (15.5?i) among learner cognitive attainment values ' 

can be explained by examining the-perfortnance of learners taught by 

a particular student teacher: This-flndlng Is cojnpa title with values 

reported by Denton h McNamara (in press) and Murine (1975) when 



pupiV achievement dati sets were partitioned by classroom assignment 
then cQopared. It is not unreasonable or unlikely to expect that 
instructional behavior patterns* of indivtiSual student, teachers in this • 
investigation were different, further, it is possible thes.e varying 
instructional behaviors among teaching candidates would result in 
cognitive attairanent fluctuations across groups of learners. The 
analysis related to this question confirms these conjectures. 

If we return, to the assessment issues addressed at the beginning • 
of this paper, the findings to question 4 can be interpreted differently. 
On the one hand, if tl^ej:eaching candidate has successfully demonstrated 
iMstery of the necessary and essential instructional skills identified 
for a preparation program," the observed varp.ation of cqgnltfve attainment 

anKjng learners across different student teachers could be dismissed 

, - ■ . ^ ■ ■" ■ 't 

as an artifact of the abilities and backgrounds of the learners. The , 

observed variation regarding learner attainment would be expected 

because the .learners represent many different backgrounds and cognitive 

abilities. The fact that prior xognitive attainment was taken into 

account in. this investigatiqn would not explain variation due to other 

unspecified characteristics of the learners. Given this approach to 

preservice teacher assessment there would be no need to explain the 

variation in learner performance as a function of the teaching 

candidate's instructional skills, since characteristics of the learners 

pvershadow the influence of the teacher's- instructional behavior. ^ 

Conversely, if the alternate position to preservice teacher 

assessment is taken, namely,. that learner cognitive attainment is the 

criterion variable for determining a student teacher's competence, then , 

the finding for research question 4 indicates the preparation program 

had unequal effects on different Reaching candidates. There are many 



,corvjectufes about the SJ^rce of this variationjifbr example, other 
academic characteristics of student teachers besides overall grade 
point ratio and academic major of the candidate may. directly influence 
this variation In instructional behaviors of teaching candidates, k 
However ,-4t is also possible that components of_ the secondary teacher 
preparation program are not adequately preparing the candidates to 
carry (Kit>the classroom. responsibilities of a teacher. Assigning this 
latter explanation-has merit* the use of leamer-attaintnent data for 
preseryice teacher assessment then serves dual functions. This approach 
provides direct evidence concerning the teaching candidate's ability to 
bring abou^t demonstrated growth of secondary learners, while providing 
suoinative evalution data for the preparation program. 

In closing, the results of this investigation underscore the 
importance of ai?! looting multiple sources of data on each teaching 
candidate. Certainly olher variables not addressed in this investigation 
("Classroom observation summaries, learner perceptions of the student 
teacher's cocnpetence, classroom supervisor ratings, unit pretest scores) 
and transformations of the variables consider^i in this Investigation 
may increase the explanatory povyer of a regress 1on~model on learner 
cognitive attainment and should be considered In future /researches. 

Further, this investigation has demonstrated that it is feasible 
to iropl_en»nt a McNeil -Pophsn type of contract pi alf in an. ongoing 
student teaching h^osmwr. In. €s^sence, the McNei l-Pop}«m pi an ^o«es 
a raanagement system for Implementing a student teaching program which 
collects cognitive attainment cUta from learners of student teachers'. 
This plan has "great potential not only for preparing teachers who are 
"accountable" for producing learner growth but for evaluating and 
improving existing teacher prepartlon programs as well. 
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Table 1 . 

Sumnary of Characteristics of Unit Two Tests 
Oevel(^ and Implemented by Student Teachers 
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addressed by test items 
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' 28 ! 


(3) knowledge/ (2) application* 
knowledge * 
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■■'■3 
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knowledge 


19 " 


5. 


24 


(2) knowledge/ (3; application*. 


20 




n 


knowledge 


21 


2 


21 


(T)knowledge/ (1 ) application* 



I 



* Number in paV-entheses represents the number of objectives of each type 
represented on the test. 
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Lddger 



Variable Ledger for tables 3-7 



I 



r 



J 



Y| > learner cognitive attainraent on the initial unit taught 
tuy the student teacher ; 

' ' ' . ' ■ ' - ■ ' • 

P| « Overall grade point ratio of student teacher 

• Undergraduate oiajor of student\edch€r \ • - 
T, • Prior solo teaching time' of student teacher * . 

• Opportunity to learn time fc\y student- teacher 

• Planning effectiveness of ^student teachgr 
Sg * Instructi4)nal e^ectiveness of student teach 
t;^ .^Student teacher identification ; . - 
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statistical SyBmary of Regression Equation for ftod^ 1. 
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Std, Error 
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intercept 
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Table 4 








# Statistical ^urooiary of Regression Equation for Model 2 " ^' 




Multiple R ; 
&td. Error 
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Regression : 
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• statistical Sumnary of Regression Equation for Model 3 
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Intercept 38.19 
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. Table 6 ' 
SiHiwary of Regression Equajtion for Model. 4 
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- .^2,: \ Statisticai Siamary of Regression Equation for Model 5 ,, 
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